Exploiting Sequence Analysis for Accurate Light-Field Depth Estimation
نویسندگان
چکیده
Depth estimation for light field (LF) images is the cornerstone of many applications cameras, such as 3D reconstruction, defects inspection, face liveness detection, and so forth. In recent years, convolutional neural network (CNN) has dominated primary workhorse depth estimation. However, interpretability accuracy results still need to be improved. This paper uses conditional random (CRF) theory explain model LF Further, from perspective sequence analysis, we extract features epipolar plane image (EPI) patches with recurrent (RNN) serve unary term energy function in CRF. Then, a unified (called LFRNN) designed solve CRF get map. Our LFRNN builds upon two-stage architecture, involving local refinement. first part, design an RNN analyze vector sequences EPI obtain values. There are two thinking behind this part. The general principle that slope straight line inversely proportional depth; second our unique observation those lines distributed sequences. continuous used optimize output We train on synthetic dataset test it both real-world datasets. Quantitative qualitative validate superior performance over state-of-the-art methods.
منابع مشابه
Accurate Light Field Depth Estimation with Superpixel Regularization over Partially Occluded Regions
Depth estimation is a fundamental problem for light field photography applications. Numerous methods have been proposed in recent years, which either focus on crafting cost terms for more robust matching, or on analyzing the geometry of scene structures embedded in the epipolar-plane images. Significant improvements have been made in terms of overall depth estimation error; however, current sta...
متن کاملDepth Estimation for Glossy Surfaces with Light-Field Cameras
Light-field cameras have now become available in both consumer and industrial applications, and recent papers have demonstrated practical algorithms for depth recovery from a passive single-shot capture. However, current lightfield depth estimation methods are designed for Lambertian objects and fail or degrade for glossy or specular surfaces. Because light-field cameras have an array of micro-...
متن کاملDepth Estimation Through a Generative Model of Light Field Synthesis
Outline. We show our results on various datasets, including images taken with the Lytro by Tao et al. [2013] and our own dataset, images from the Stanford light field dataset [sta, 2008] and results on an artificial dataset [Wanner et al., 2013]. Furthermore, we expand on details such as the triangular function and the selection of the parameters. Finally, we discuss implications of our no-occl...
متن کاملDepth Estimation of Light Field Images by Optical Flow
Light field images present a rich, compact, dataset of multiple images of a scene from slightly shifted viewpoints. I explore the use of an optical flow algorithm on light field images to estimate depth. The optical flow algorithm is simple to implement as does not require finding correspondences between images. Further, I explore the use of image priors and modern optimization techniques to fo...
متن کاملJoint Blind Motion Deblurring and Depth Estimation of Light Field
Removing camera motion blur from a single light field is a challenging task since it is highly ill-posed inverse problem. The problem becomes even worse when blur kernel varies spatially due to scene depth variation and high-order camera motion. In this paper, we propose a novel algorithm to estimate all blur model variables jointly, including latent sub-aperture image, camera motion, and scene...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3296800